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Abstract This work aims to introduce a new concept for incorporating fuzzy 
sets in hybrid deliberative/reactive paradigm . After a brief review on basic 
issues of hybrid paradigm the definition of agent-based fuzzy hybrid 
paradigm, which enables the agents to proceed and extract their behavior 
through quantitative numerical and qualitative knowledge and to impose 
their decision making procedure via fuzzy rule bank, is discussed. Next an 
example performs a more applied platform for the developed approach and 
finally an overview of the corresponding agents architecture enhances agents 
logical framework. 


1 Introduction 


The definition of the agents world could be based on their social rules, 
communication cooperation and negotiation between them and their pursuance to 
achieve the defined (pre- given) goals. The central concerns on this area refer from 
one side to the individual design aspects for developing the design task and leading to 
an improved behavior and from another side to their social rules, cooperation of the 
individuals, and consideration based on the relationship between individual and 
overall social behaviors. The design aspect should be suitable for time constraint 
environment and interactions with environment in order to make agents capable to 
reconfigure and recover from changes due to environment and satisfy other flexible 
design criteria. Intelligent agents acquire information from the world interface and are 
able to perform tasks which are supposed to meet deadline on average [2]. 

In heterogonous approach the agents may differ from each other to ensure multi 
robot coordination. Self regulation agents concept is embedded within the 
environment and their autonomous action meets the design objectives. Part of the 
problem from individuality point of view refers to path planning and navigation, 
which implies the complexity of the problem and represents the physical limitations 
of robot platform. 

In a human-based model of agents there is* a close dependent between the 
deliberation, reaction and decision making and the agents relationship functional 
structure models these criteria [8]. If we face the unstructured or local environment 
the reactive planning is the most appropriate execution meanwhile in a knowledge 
rich environment (globai/open world) a hierarchical paradigm works better based on 
deliberation process of global information and agent specific abstraction. Deliberation 
functions could not extend independently of reactive behavior and vice versa. Hybrid 
architectures benefit both concepts of reactive and deliberative paradigm [5]. 



2 Incorporation of Fuzziness into Hybrid Paradigm 


As stated above the agents should have some reactive design-base due to changes in 
environment, which in turn may effect and result in some limitation in the agents 
(local) goals and deliberation paradigm, which through reasoning procedure and 
intention tend to lead to action to achieve the goals (mean-ends). Therefore we need 
to balance between goal directed (deliberative) and reactive paradigm. Fuzzy 
approach can perform a suitable area for considering both these aspects, through 
which our decision function is a fuzzy one which proceeds the action design choice 
influenced by history and reconsideration and makes the agents enable to develop 
cognitive functions for evolution of intelligence. 

Deliberation and reactivity face with problems of multiple conflicting criteria and 
multiple objectives. With incorporation of fuzziness into hybrid paradigm we can 
make decisions with vague, uncertain and inexact objects and extract the human 
knowledge in planning architecture without articulating an application-based world 
model and prepare a determinative interpretation from probability and randomness. 
Fuzzy approach profits knowledge representation about how the agents represent their 
world, plan and solve problems in close/open world and is appropriate to experiment 
on bold (never reconsider) to cautious (constantly reconsider) agents, since the 
decision procedure attempts to degree. 

2.1 Development of the Concept of FHDRP 

The decision making strategy will be based on a deliberation-reaction fuzzy rule bank 
with strategy acquisition in extracting the fuzzy rules incorporating with real time 
reasoning [3,4,6] (we can learn the fuzzy rules from experiences with numerical 
and/or linguistic sample data with enhancing the system profiting the ability of 
learning-base systems such as neural networks.). 

The fuzzy deliberative/reactive rule bank could be defined as follow: 

-FRB: 0r„C„4), / = 1,2,...,«. , 

Where: 

-Deliberation state conditions: X t = {X n , X i2 , . . . s X im } . 

With deliberation fuzzy set: D = {(JSf , m D (X)^X € Q. is the universe of the 
deliberations. 

-Reaction state conditions: C i = {C n , C i2 C is } . 

With reaction fuzzy set: R = {(C, m R (C))C6 is the universe of the 

reactions. 

-Action through deliberation and reaction: A { = {zl n , A i2 A ik }. 

With action fuzzy set: A c = §A,m Ac (A)]ag r} T is the universe of the actions. 
The fuzzy hybrid paradigm can be defined as the projection: 

DxR A c . Where D is deliberation, R is reaction and A c is action power set. 
The i-th fuzzy rule seems like: 





If ( x a is f A and X a is f xl ... and X in is f m ) and if (C n is f el and C i2 is 

f cl ■■■ and C is is fa ) then A is far 

So the behavior could be written as: Beh ciRxRxR, ordering on R and could be 
defined as: 

-Beh = {(X i ,C i ,A i ) | XeD,CeR,Ae A c }, or 

-Beh = R U X n x X a x ...x X. m xC n xC a x...xC is x A n x A a x...x A ik . 

i=l 

The parallel associative inference will fire each fuzzy rule in parallel but 4o different 
degrees. 

As a traditional defuzzifier approach the max-height method can be used: 

p 

- m A c (A * ) = max ™a c (A)- 

The defuzzification procedure can be completed with the priority rule or the 
subsumption theory developed by Brooks [1]. Therefore we get the inhibition relation 
in the hierarchy as follow: 

A i -< Aj if (A t , A j) e-< , and we read it: 

A. inhibits A } or A { is lower in hierarchie than A } . 


2.2 Example 

As an example (modified from [7] and [8]): 

Suppose the objective is to collect samples in an indoor environment of a 
particular type in a predefined place. The location of the samples is not known. A 
number of autonomous swarm agents are for this problem available which can go 
around and collect the samples. Furthermore the terrain is full of obstacles. This 
organized team of robots can in turn negotiate and cooperate together and divide up 
the task collaborating with a common coordinator and the individuals have 
autonomous decisions and navigations. 

In this problem we face with a mix of path and deliberation/reaction planning and 
we need a path planning algorithm (for further detail see next section) as well, which 
sufficiently represents the terrain. 

We could extract some fuzzy deliberatioirireaction rules considering agents 
specific criteria and agents cooperation, for example: 

-Deliberation (if there are more samples in one direction. Mo ve-to-that- direction) and 
Reaction (if near a sample and obstacles or other agents are far, Speed-up-towards- 
the-sample). 

-Deliberation (if the obstacle is far, Choose-the-up-gradient-direction-toward-the- 
sampie, Move-to- sample) and Reaction (if the obstacle is very close, Change-the- 
direction). 

-Deliberation (if your partner is closer than you to a sample and there are fewer 
obstacles in his way, Communicate-with-your-partner and Let-him-to-pick-it-up). 


-Deliberation (if another agent near you has more frustration, Go-in-his-direction and 
Pick-up-the-sample). 

-Deliberation (if many other agents in one direction, Choose-another-direction) and 
Social rule (if another agent near you Wait or Tum-to-the-left). 

And so on. 

We can inteipret for all of the linguistic notions mentioned above, which can not 
be exactly described, such as: more, near, far, close, few,... the corresponding fuzzy 
sets and with defining the degree of indeterminacy articulate numerical data structure 
for partial occurrence of events or relations and have a quantitative interpretation 
from probability and randomness. 

Finally pure reactive rules such as: A void-obstacle, finding a sample Take-it and 
carrying samples and at the base Drops-the-samples have the most priority and 
complete the decision procedure with inhibition characteristics. 


3 FHDRP Control Architecture of the Agents 

The design-base is appropriate for real time execution and the state hierarchy 
develops a layered intelligent structure, whereby each layer could be interpreted as 
software agent or function in order to develop logic based concepts of robots and 
assure a modular construction for replaning and adapting the configuration. 

The control strategy suggested and the proactive behavior could be based on 
supervisory control on agent level. Coordinated decision must be suitable for 
application specific behavior on user level program embedded in the controller at run 
time. Application specific information, control algorithm and planning strategy 
specify the agent code. We should define the optimal in favor of our data base, rule 
base and changes that will occur in the environment. 

The approach (fig. 1) is based on SENSE then PLAN ACT, whereby the sensed 
information goes through planning layer and by means of directives translates to 
actuator commands on a hierarchical paradigm. One of the inputs to the systems will 
be sequences of environment states or percepts through which the control rules will 
extract some deliberative/reactive behaviors. Action rules translate to the effectors via 
corresponding sensor system through pattern of motor schema action. The developed 
concept is applicable to both local and cooperative planning. 

The fuzzy approach develops the social ability and satisfies the abilities due to 
uncertainty in the world model and provide a balance between goal directing and 
reactivity and interactions between the agents in order to coordinate and control them, 
using Quantitative numerical and qualitative knowledge. Fuzzy rules consider 
attention, reasoning, and information collection. We need real time processor to 
proceed with fuzzy reasoning about the global state to select the best behavior. 

The behavioral manager plans which behavior to use in order to progress to the 
goal and there are assumptions mappings from global data structure (sensory inputs) 
to behavior generation. 

Behaviors are inherently parallel and distributed and the goal directed approach is 
a sequence of generic behavior and updating the behavior. 

Sequencer as in the general hybrid architecture generates the set of behaviors, 
adapts it with managerial style and subdivides the deliberation based on the control 
scope and enables the system to develop a behavior based control for coordinating 



planful activities with real time behavior for dynamic positioning, navigation 
(behavior based opportunity to change direction of navigation) and considering the 
goals, resources and timing constraints. 


Perceptual input 



Fig. 1 FHDR Control architecture of agents 

Cartographer is responsible for information collection (data structure) and path 
planning. Physical location of agents and the coordinated control program will be part 
of global knowledge and shared data structure. To find the optimal path in the 
configuration space, event noticeable by reactive system would trigger event-driven 
replaning. 

Path generation algorithm will generate a pre completed path with a hill climbing 
algorithm to reach to the target position, where the target position is given by the 
strategy system and behavioral controlling of the moving direction of the agent is 
based on the direction of the target point and agent actual coordinates [6]. 

If an obstacle blocks the path, the path is replaned and optimized by computing 
the optimal route and decomposing it into waypoints [5], a goal to reach. After 









reaching each waypoint next goal is computed and cartographer gives the sequencer a 
set of waypoints to make a qualitative navigation possible. 

Solutions to the problems such as interference, member unproductive or failed, 
agents interactions and communications, individuality and autonomy, emergent 
behavior and heterogeneity could be in collaborating with the coordinator. 
Coordinator defines new goals and sets the strategical plans, which lead to tactical 
instructions and coordinate the relationship between strategy and agents set of tactical 
behavior through social rules. Coordinator can modify the relationship between the 
behaviors of agents: one strategy and several tactics. 


4 Future Directions 

For a later work we could enhance the agents architecture with learning-base 
distributed AI systems such as neural networks to learn from experiences and new 
data and be able to improve the agents behavior. The learning system should develop 
the ability of on-line learning in time critical environment using qualitative 
abstraction, symbolic learning algorithm and rules generation and challenge the 
autonomous learning of sequential behavior and gain some skills to carry out the plan 
for more robustness and performance monitoring. We could also investigate on 
stability, redundancy and complementary of the system. 
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